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GLOBAL ASYMPTOTIC CONTROLLABILITY IMPLIES INPUT TO 

STATE STABILIZATION* 

MICHAEL MALISOFF+, LUDOVIC RIFFORD* , AND EDUARDO SONTAG § 

Abstract. The main problem addressed in this paper is the design of feedbacks for globally 
asymptotically controllable (GAC) control affine systems that render the closed loop systems input to 
state stable with respect to actuator errors. Extensions for fully nonlinear GAC systems with actuator 
errors are also discussed. Our controllers have the property that they tolerate small observation noise 
as well. 
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1. Introduction. The theory of input to state stability (ISS) forms the basis for 
much of current research in mathematical control theory (see ^3E21EiI|)- The ISS 
property was introduced in [T^]. In the past decade, there has been a great deal of 
research done on the problem of finding ISS stabilizing control laws (see |Tllcflli3HT2"]). 
This note is concerned with the ISS of control systems of the form 

(1.1) x = f(x) + G{x)u 

where / and G are locally Lipschitz vector fields on R™, /(0) = 0, and the control 
u is valued in M. m (but see also fJHl f° r extensions for fully nonlinear systems) . We 
assume throughout that (|1.1|1 is globally asymptotically controllable (GAC), and we 
construct a feedback K : R n — > R m for which 

(1.2) x = f(x) + G{x)K{x) + G{x)u 

is ISS. As pointed out in [HIE], a continuous stabilizing feedback K fails to exist in 
general. This fact forces us to consider discontinuous feedbacks K, so our solutions 
will be taken in the more general sense of sampling and Euler solutions for dynamics 
that are discontinuous in the state. By an Euler solution, we mean a uniform limit 
of sampling solutions, taken as the frequency of sampling becomes infinite (see fJ2]for 
precise definitions). This will extend ^5] EH], which show how to make C°-stabilizable 
systems ISS to actuator errors. In particular, our results apply to the nonholonomic 
integrator (see |H1E3]> and ^Jbelow) and other applications where Brockett's condition 
is not satisfied, and which therefore cannot be stabilized by continuous feedbacks (see 

EH EH EH) 
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Our results also strengthen jS] , which constructed feedbacks for GAC systems that 
render the closed loop systems globally asymptotically stable. Our main tool will be 
the recent constructions of semiconcave control Lyapunov functions (CLF's) for GAC 
systems from |16l II 7) . Our results also apply in the more general situation where 
measurement noise may occur. In particular, our feedback K will have the additional 
feature that the perturbed system 

(1.3) x = f(x) + G{x)K (x + e) + G(x)u 

is also ISS when the observation error e : [0, oo) — > 1" in the controller is sufficiently 
small. In this context, the precise value of e(t) is unknown to the controller, but 
information about upper bounds on the magnitude of e(t) can be used to design the 
feedback. We will prove the following: 

Theorem 1.1. If is GA C, then there exists a feedback K for which 

is ISS for Euler solutions. 

The preceding theorem characterizes the uniform limits of sampling solutions 
of 1|1.3I) (see ^21 for the precise definitions of Euler and sampling solutions). From 
a computational standpoint, it is also desirable to know how frequently to sample 
in order to achieve ISS for sampling solutions. This information is provided in the 
following semi-discrete version of Theorem II. II for sampling solutions: 

Theorem 1.2. If is GAC, then there exists a feedback K for which 

is ISS for sampling solutions. 

This paper is organized as follows. In |5J we review the relevant background on 
CLF's, ISS, nonsmooth analysis, and discontinuous feedbacks. In we prove our 
main results. This is followed in 21by a comparison of our feedback construction with 
the known feedback constructions for C°-stabilizable systems, and an application of 
our results to the nonholonomic integrator. We close in SjSJwith an extension for fully 
nonlinear systems. 

2. Definitions and Main Lemmas. Let /Coo denote the set of all continuous 
functions p : [0, oo) — > [0, oo) for which (i) p(0) = and (ii) p is strictly increasing and 
unbounded. Note for future reference that /Coo is closed under inverse and composition 
(i.e., if p\,p2 £ /Coo, then p^ 1 , pi o p 2 £ /Coo)- We let K.C denote the set of all 
continuous functions (3 : [0, oo) x [0, oo) — * [0, oo) for which (1) /3(-,t) £ /Coo for each 
t > 0, (2) [3(s, •) is nonincreasing for each s > 0, and (3) (3(s, t) — > as t — > +oo for 
each s > 0. 

For each k £ N and r > 0, we define 

M k = {measurable u : [0,oo) — > R fc : \u\oo < oo} 

and M.* := {u £ M k : |u|oo < r}, where | • |oo is the essential supremum. We let 
||u(s)||j denote the essential supremum of a function u restricted to an interval /. Let 
| • | denote the Euclidean norm, in the appropriate dimension, and 

rB k := {x £ R k : \x\ < r} 

for each k £N and r > 0. The closure of rBk is denoted by rBk, and bd(5) denotes 
the boundary of any subset S in Euclidean space. We also set 

O :={e: [0, oo) -> M™}, sup(e) = sup{|e(i)| : t > 0} 

for all e £ O, and O v :— {e £ O : sup(e) < 77} for each n > 0. For any compact set 
T C W 1 and e > 0, we define the compact set 

T E := {x £ 1" : min{|x - p\ : p £ T} < e}, 
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i.e., the "e-enlargement of JF". Given a continuous function 

h : E n x R m -> R™ : (x, u) h-> %, w) 

that is locally Lipschitz in .t uniformly on compact subsets of R" x R m , we let 
<ph{' ,x ,u) denote the trajectory of x = h(x,u) starting at x G R n for each choice 
of u G M. m . In this case, <ph{-,x ,u) is defined on some maximal interval [0, t), with 
t > depending on u and x . Let C k denote the set of all continuous functions 
(p : R™ — > R that have at least k continuous derivatives (for k = 0, 1). We use the 
following controllability notion, which was introduced in lj|J and later reformulated 
in terms of ICC functions in |22| : 

Definition 2.1. We call the system x = h(x,u) globally asymptotically control- 
lable (GAC) provided there are a nondecreasing function a : [0, oo) — > [0, oo) and a 
function (3 G ICC satisfying the following: For each x G R ra , there exists u G M m 
such that 

(a) \<ph{t, x , u)\ < f3(\x \, t) for all t > 0; and 

(b) \u{t)\ < a(\x \) for a.e. t > 0. 

In this case, we call a the GAC modulus of x — h(x,u). 

In our main results, the controllers will be taken to be discontinuous feedbacks, so 
the dynamics will be discontinuous in the state variable. Therefore, we will form our 
trajectories through sampling, and through uniform limits of sampling trajectories, 
as follows. We say that ir — {t a , t\, t 2 , . ■ .} C [0, oo) is a partition of [0, oo) provided 
t Q = 0, ti < t i+ i for all i > 0, and — > +oo as i — * +oo. The set of all partitions of 
[0, oo) is denoted by Par. Let 

F : R n x W n x R m -» R n : (x,p, u) ^ F{x,p, u) 

be a continuous function that is locally Lipschitz in x uniformly on compact subsets 
of R™ x R m x R m . A feedback for F is defined to be any locally bounded function 
K : R™ — > R™ 1 for which K(Q) = 0. In particular, we allow discontinuous feedbacks. 
The arguments x, p, and u in F are used to represent the state, feedback value, and 
actuator error, respectively. 

Given a feedback K : R" -> R m , tt = {t Q , ti,t 2 , . . .} G Par, x a G R", e G O, and 
u G M, m , the sampling solution for the initial value problem (I VP) 

(2.1) x(t) = F(x(t),K(x(t) + e(t)), u(t)) 

(2.2) x(0) = x Q 

is the continuous function defined by recursively solving 

(2.3) x(t) = F{x{t),K{x{U) + e{U)),u{t)) 

from the initial time ti up to time Si = ti Vsup{s G [U, tf+i] : x(-) is defined on [ti, s)}, 
where x(0) = x . In this case, the sampling solution of Q2. 1(1 - 1)2. 2[l is defined on the 
right-open interval from time zero up to time t = inf{si : Sj < This sampling 

solution will be denoted by t i— > ar ff (t; x , zt, e) to exhibit its dependence on 7r G Par, 
ir G R", u E A4 m , and e G 0, or simply by x„, when the dependence is clear from the 
context. Note that if &j = for all i, then < = +oo (as the infimum of the empty 
set), so in that case, the sampling solution 1 1— > ar,r(t; x , u, e) is defined on [0,oo). 

We also define the upper diameter and the lower diameter of a given partition 
7r = {t ,ii,i 2 , • ■ ■} by 

d(7r) = sup(t i+ i - U), d(ir) = m{(U+i - U) 
i>0 l >° 
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respectively. We let Par(<5) := {ir G Par : d(7r) < 5} for each S > 0. We will say that 
a function y : [0, oo) — > R™ is an Euler solution (robust to small observation errors) of 

(2.4) x(t)=F{x(t),K(x(t)),u(t)), x(0)=x o 

for u G A^™ 1 provided there are sequences 7i> G Par and e r £ O such that 

(a) d(7r r ) ^ 0; 

(b) sup(e r )/d(7r,.) — > 0; and 

(c) 1 1 !■ a^^t; x , u, e r ) converges uniformly to y as r — > +oo. 

Note that the approximating trajectories in the preceding definition all use the same 
input u (but see Remark 12 .41 for a more general notion of Euler solutions, which also 
involves sequences of inputs) . 

This paper will design feedbacks that make closed loop GAC systems ISS with 
respect to actuator errors. More precisely, we will use the following definition: 

Definition 2.2. We say that \2. 1)) is ISS for sampling solutions provided there 
are (3 G ICC and 7 G /C^ satisfying: For each e, M, N > with < e < M , there exist 
positive 5 — S(e, M, N) and n — n{e, M, N) such that for each 7r G Par((5), x G MB n . 
u G M^, an d e G O for which sup(e) < k6.(tt), 

(2.5) \x v (t; e)| <max{p(M,t)+j(N),e} 
for allt > 0. 

Roughly speaking, condition Ij2.5|l says that the system is ISS, modulo small 
overflows, if the sampling is done 'quickly enough', as determined by the condition 
tt G Par(<5), but 'not too quickly', as determined by the additional requirement that 
d(7r) > (l/«;)sup(e). In the special case where the observation error e = 0, the 
condition on d(7r) in Definition 12.21 is no longer needed; our results are new even for 
this particular case. 

Notice that the bounds on e are in the suprcmum, not the essential suprcmum. 
It is easy to check that Definition 12 . 21 remains unchanged if we replace the right-hand 
side in (|2.5() by (3(M, t) + j(N) + e. We also use the following analog of Definition 12. 21 
for Euler solutions: 

Definition 2.3. We say that the system 12.1)) is ISS for Euler solutions provided 
there exist (3 G KC and 7 G /Coo satisfying: If ' u G M. m and x a G M™, and if 1 1— > x(t) 
is an Euler solution of \2.J$ , then 

(2.6) |a;(t)|<j9(|a: o | > t)+7(|u| 0O ) 
for all t > 0. 

Remark 2.4. In the definition of Euler solutions we gave above, all of the approx- 
imating trajectories 1 1— > x 7Tr (t; x a , u, e r ) use the same input u G M. m . A different way 
to define Euler solutions, which gives rise to a more general class of limiting solutions, 
is as follows: A function y : [0, 00) — * W 1 is a generalized Euler solution of (|2.4|) for 
u G M m provided there are sequences n r G Par, e r G O, and u r G M m such that 

(a) d(7r r ) -> 0; 

(b) sup(e r )/d(7iy) 0; 

(c) |u r |oo < \u\ao for all r; and 

(d) 1 1— > x nr (t; e r ) converges uniformly to y as r — * +00. 

We can then define ISS for generalized Euler solutions exactly as in Definition 12. 3\ by 
merely replacing "Euler solution" with "generalized Euler solution" throughout the 
definition. Our proof of Theorem 11.11 will actually show the following slightly more 
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general result: If Ijl.lfl is GAC, then there exists a feedback K for which (|1.3fl is ISS 
for generalized Euler solutions. 

Our main tools in this paper will be nonsmooth analysis and nonsmooth Lyapunov 
functions. The following definitions will be used. Let f2 be an arbitrary open subset 
of R" . Recall the following definition: 

Definition 2.5. Let g : — > R be a continuous function on fl; it is said to be 
semiconcave on provided for each point x Q G ft, there exist p,C > such that 

g( x )+g(y)-2g(^±y^<C\\ X -y\\ 2 

for all x, y G x Q + pB n . 

The proximal super differential (respectively, proximal subdifferential) of a function 
V : O — > R at x G f2, which is denoted by d p V(x) (resp., dpV(x)), is defined to be 
the set of all ( G R™ for which there exist a, r\ > such that 

V(y) - V{x) - o\y - x\ 2 <((,y- x) (resp., V(y) - V{x) - a\y - x\ 2 >((,y~ x)) 

for all y G x + i]B n . The limiting subdifferential of a continuous function V : fl — > R 
at x G fl is 

d L V(x) := {q G R" : 3x n -> x k, q n G d P V(x n ) s.t. q n -> g}. 

In what follows, we assume h : 1™ x R m — > R™ : (x,m) i— > h(x,u) is continuous, 
that it is locally Lipschitz in x uniformly on compact subsets of R™ x R m , and that 
h(0,0) = 0. The following definition was introduced in |18j and reformulated in 
proximal terms in [22| : 

Definition 2.6. A control-Lyapunov function (CLF) for 

(2.7) x = h(x,u) 

is a continuous, positive definite, proper function V : R" — > R for which there exist 
a continuous, positive definite function W : R™ — > R, and a nondecreasing function 
a : [0, oo) — > [0, oo), satisfying 

VC G 9pV(a;), inf (C, /i(x, u)) < -W(x) 

|ii|<a(|xj) 

/or all x G R™. /n this case, we call (V, W) a Lyapunov pair for l|2.7p . 
Recall the following lemmas (see |17j1: 

Lemma 2.7. // \2. r l\j is GAC, then there exists a CLF V for \2.'J\ l that is semi- 
concave on R™ \ {0}, and a nondecreasing function a : [0, oo) — » [0, oo), that satisfy 

(2.8) VC G d L V(x), mm ((,h(x,u)) < -V(x) 

\u\<a(\x\) 

for all x G R™. 

Lemma 2.8. Let V : f2 — * R be semiconcave. Then V is locally Lipschitz, and 
7^ 8lV(x) C d p V(x) for all x G ft. Moreover, for each compact set Q C Q, 
there exist constants a, jj, > smc/i f/iat V(y) — ~~ °~\y — x\ 2 < (C,y — x) for all 
y G x + [iB n , all x G Q, and all £ G d p V(x). 

Notice that Lemma 12.81 allows the constants in the definition of d p V(x) to be 
chosen uniformly on compact sets. 

Remark 2.9. In |17j . the controls u take all their values in a given compact metric 
space U. The precise version of the CLF existence theorem in J7| is the same as our 
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Lemma |2. 71 except that the infimum in the decay condition (|2.8[1 is replaced by the 
infimum over all u S U . The version of Lemma 12.71 we gave above follows from a 
slight modification of the arguments of |16M17| . using the GAC modulus in the GAC 
definition (see Definition 12. lj l. The existence theory j^] for semiconcave CLF's is a 
strengthening of the proof that continuous CLF's exist for any GAC system (see |18|K 

3. Proofs of Theorems. Let V be a CLF satisfying the requirements of Lemma 
12 .71 for the dynamics 

(3.1) h(x, u) = f(x) + G(x)u. 
Define the functions a, a 7 € /Coo by 

(3.2) Q.(s) = min{|x| : V(x) > s} and a(s) = max{|x| : V(x) < s}. 
One can easily check that 

(3.3) Vx S E™, a(V(x)) < \x\ and a(V(x)) > \x\. 

Moreover, by reducing a, we may assume that a(s) < s for all s > 0, while still 
satisfying (|3.3|l . 

Let x i— » Q(x) be any selection of 8lV{x) on W 1 \ {0}, with £(0) := 0. For each 
x e W l , we can choose u — u x S a(|a;|)S m that satisfies the inequality in (|2.8|l for the 
dynamics (ED) and C = C{x). Define the feedback i^i : E n -> R ro by ^(ar) = u x for 
all a; ^ and i^i(0) = 0. We use the functions 

a(x) = {((x)J(x)+G(x)K 1 (x)), b 3 (x) = (((x), 9j (x)) Vj 
1 J = -nx)(sgn{6 1 ( S )},sgn{fe 2 (a;)},... ! sgn{6 m ( a; )}) T ' 

where gj is the jth column of G for j = 1, 2, . . . , m, and 

r i, s > o 

sgn{s} = < —1, s < . 

[ 0, s = 

We remark that our results remain true, with minor changes in the proofs, if the 
factor —V(x) in the definition of K2 is replaced by —W(x) for an arbitrary positive 
definite proper continuous function W : K™ — > K. In particular, K :— K\ + K2 is a 
feedback for the dynamics 

F(x,p,u) = f(x)+G(x)(p + u). 

Moreover, 

(3.5) a(x) < —V(x) < Vi e 1" \ {0}. 
We next show that 

(3.6) x(t) = F(x(t),K(x(t) + e(t)),u(t)) 

is ISS for sampling solutions. 

To this end, choose e, M, N > for which < e < M . It clearly suffices to verify 
the ISS property (|2.5|l for e < 1, since that would imply the property for all overflows 
e > 0. Choose 

(3.7) ueM%, eeO e/16 , x eMB n . 
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In what follows, denotes the sampling solution for 1(3.6(1 for the choices 1(3 . 7(1 and 
7r G Par, and is the (possibly discontinuous) function that is inductively defined 
by solving the IVP 

x(t) = f{x{t)) + G{x{t))[K{ Xl ) + u(t)}, x{U) = x t 

on [U,t i+ i), where x% := x t + e(U), %i '■= Xn(U), and n = {t ,ti,t 2 , ■ ■ .}. We later 
restrict the choice of n so that and defined on [0, oo). We will use the 

compact set 

Q = { [a o a-\N + M) + l] B n } \ eB n . 

Notice that Q,Q e/2 C M™ \ {0}, and that x a G Q e . Using Lemma PI and the 
semiconcavity of V on 1™ \ {0}, we can find a, \i > such that 

(3.8) V(y) - V(x) < (C(x), y- x )+a\y- x\ 2 

for all y G x + [iB n and x G Q £ / 2 . Let £ e > 1 be a Lipschitz constant for V on Q e / 2 , 
the existence of which is also guaranteed by Lemma 0751 It follows from the definition 
of a CLF that 

A_ :=min{V»:pGQ £ / 2 } 
1 j A+ := max{F(p) :p£ Q £ } 

are finite positive numbers. Therefore, we can choose e G (0, e) for which 

(3.10) a (p+^f^j < 5(p) + | Vp G [0,of + A+] . 
We can also find 

(3.11) S = S(e,M,N) G [0, 



16 + A+ + 16A 4 
such that if 

(3.12) 7T G Par(<y), e G Og/ie, ar< € Q £ , 

and if i G [ij, ij+i) is such that x 7T (s) and x T (s) remain in Q 2e for all s G [t;, t], then 



(3.13) max{|a; 7r (t) - x t \, \x^{t) - < min|/x, 16 ^ £ p y ^r(< - *t) j • 

This follows from the local boundedness of K, / and G. It follows from 1(3.13(1 that 
x„(t) G Q £ / 4 (resp., G Q £ ^ 4 ) for all f G [U,U+i) and all i such that x% G Q 

(resp., G Q), since the trajectories cannot move the initial value more than and 
there are no blow up times for the trajectories. In particular, 1(3.13(1 will show that 
x^ and ijr are defined on [0, oo), since the argument we are about to give shows that 
Xi G Q e for all i. By reducing S as necessary, we can assume 

,„ ^ IIC&) • (FfaKixiW)) ~ /(**(*)) 

1 ' -G&m*(*)+K(£i)])\\iu,u + i)<¥ 
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for all i such that x^ € Q e ^ 2 . This follows from the Lipschitzness of / and G on Q e . 
Having chosen S to satisfy the preceding requirements, pick any n £ Par(i5). It follows 
from (GEU and (|?H3|) that 

V(x„{t)) -V{xi) < (C(ii),i^(i) - ii) + o-\xir(t) - ii\ 2 

[ ' < mi),z*(t)-Zi) + ^(t-ti) 

for all t € [ti,t i+ i) and all i such that ii € Q £ ^ 4 . Moreover, if x.i G Q £ ^ 4 and 
t € [t l; ii+i), and if 

(3.16) V(£i) > N, 

then 

(C(5i), S»(t) - xi) < (c(Zi)>f t F(xi,K(xi), u(s))ds^ + ^-(t - U) (by EH) 
= (t - ii)<C(^), /(ii) + G(ziMzi)) 
+ / (C(x i ),G(s i )«(*)>da + -5-(t-*i) 



(3.17) < (t-ti)a(xi)- (t-ti)V(5i)5^|&j(5i)| 



3=1 

m . 

+ #(*-*i)X>j(5i)l + -f (t-ti) 

3=1 

<(t-ti)o(jci) + -^(t-ti) rhviprr^i 



Let 

S = {ieM":l'(i)<fl- 1 (JV)}. 

Then S C Q £ . Indeed, x £ S implies 

a o a~ (\x\) < a o a -1 o a o V(x) < N, 

and therefore \x\ < aoa^ 1 (N). By further reducing e, we can assume (2e)B n C 5. 
If Xi e Q e/4 but i, ; g 5, then V(£i) > a _1 (iV) > iV, so and l|3~T5]) give 

^(M*)) - V(xi) < -(t - U)^^- + (t - ti)^ 

(3.18) <-(t-i^ Vte^M. 

Let and £g be Lipschitz constants for / and G restricted to Q s , respectively. 
Define the constants 

R = N + sup{\K(x)\ :xe Q e/2 }, 
(3 - 19) L = C f + RC G , n = K (s,M,N):^ min { A -' £ > 



16£ £ {e LS + 1)' 
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We will presently show that 

(3.20) sup \x^{t)-x^{t)\<\e{U)\e LS Vi s.t. i, e Q £/4 . 

ti<t<t i+1 

Using (|3.2U|) . we will now find (3 £ ICC and 7 £ JC to satisfy the ISS estimate 

(3.21) \x w (t)\ < PQx \,t) + j(N) + e Vt > 

which will prove Theorem 1 1.21 

To this end, assume Xi £ Q, but that Xi ^ 5 £ / 16 . Then l|3.13|l implies x„(t) and 
x^(t) both remain in Q £ / 4 on [ti, ij+i). Moreover, S Q e ^ 4 \ S, by the choice of e in 
<|XT2jl . Therefore, if t £ [ij,t i+ i), and if 

(3.22) sup(e) < Kd(7r) 

then the choice of k gives 

y(x l+1 ) - y(x,) = V{x i+l ) - V(x n (tr +1 )) + V(x n (tr +1 )) - V&) 
+ V(xi) - V{ Xi ) 

< C E \x i+1 - x^(tr +1 )\ - -^tL — -V(xi) 

(3.23) + £ e |e(ti)| (by RFWi ) 

< C e \e(U)\e LS - t -^ r ^V(x l )+C £ \e(U)\ (by Ql) 

< ^(t i+1 - U) - t ^ ±1 -^V(x l ) (by E22I) 
16 4 

< -^-^i) (by E3) 

^j_ 1±1 _u v{Xi) ^h± 1 _u Wi)]Ce 

8 16 

< -^^M 

where we use 

- U < d(7r) < S < 1 

to get the last inequality. Set 

16 



J(t) = 



16 + t 

for all t > 0. One can easily check that Q e contains the set 

S v := {p : V(p) < max{^(g) : \q\ <M + N}}. 

In fact, p £ Sv implies 

\p\ < a (max{t/(<7) : \q\ <M + N}) 

= max {a o aT 1 o a(V(q)) : \q\ < M + N} 
<aogT 1 (M + N). 
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In particular, x Q S Sy. It follows from (|3.23|) that if none of x , X\, ... ,Xj lie in S e ^ 16 , 
then 

V(x 1 )-V(x )<-^V(x j ) 
V{x 2 )-V{x 1 )<--^V{x j ) 



Summing the preceding inequalities would then give 

V( Xj )-V(x ) < ~V( Xj ), so V( Xj ) < J(tj)V(x ) . 

Hence, 

V{x l )<J(t i )V{x ) for i = 0,l,...,j. 
By the choice of S in l|3.11fl . it would then follow from (|3.13|) that 

V(x*(t)) < J(t)V(x ) + § 

o 

up to the least time t at which x v {t) G S e > 16 . Hence, for such t, the choice of e (see 
lEH7Tll 1 gives 

\x n {t)\ < a(J(t)V(x ) + l) 
< a{J{t)V{x )) + l ' 

On the other hand, i|3.23fl also shows that if x n (t) £ S 6 ^ 8 for some t, then 

(3.24) \xn{s)\ < aoa _1 (iV) +e Vs > i. 

Indeed, let si be the first sample time above such a time t. Assume x^it) eB n . By 
(I3.13|) . 0:^(51) € S^/ 4 and ^(si) ^ |i3 n . Therefore, there exists p £ S for which 

v(xM) = vMsi)) - v(p) + v( P ) 

<C e S -+a-\N). 

In fact, we can pick p = x^^i) if x n (s{) S 5 and p S SS 1 otherwise, so p |S„. 
It follows from l|3.13|l and (|3.23|) that for the next sample time s, ; , we either have 
x n (si) £ S e / 8 , or else we have 

V(x*( Si )) <C e £ -+a-\N). 



In the first case, 



while in the second case, 



K(si)\ <aoa \N) + §, 
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by the choice of e. If x^{ Si ) <£ S"^ 16 , then V(x n (s i+ i)) < V(x n (si)) (by lj3~25)) K so 
the preceding argument also gives 

\xn(s i+1 )\ <Soa _1 (JV) + §. 

o 

By repeating this argument for subsequent sample times, the assertion (I3.24|) then 
follows from (|3.13|) . Defining [3 G /C£ and 7 G /C^ by 

(3.25) /?(s,t) = a(a~ 1 {s)J(t)) , 7(3) = So of^s), 

it follows that (|3~2T|) holds for all x a G MB n , u <E .M™, 7r G Par(<5), and e G O 
for which sup(e) < «d(7r). Therefore, Theorem 11.21 will follow once we check <|3.2U[1 . 
which is a consequence of Gronwall's Inequality. 
To this end, notice that if n G Q e ^ 4 , then 

\x*(t) - x*(t)\ < \xi - Xi\ + J (£f\xn(s) - x„(s)\ + i?£ G |x Tr (s) - x-k(s)\) ds 

for all t £ [U,ti + i), where we are using the constants in l|3.19|l . It follows from 
Gronwall's Inequality that 

Mi) - M*)| < \x< - Xil^**-***^ < \xi - Xi\e L *W < \e(U)\e LS 

for all t G [ti,t i+ i), which is (|3~^U|) . This proves Theorem IT"2l 

We turn next to Theorem 11.11 We need to show the ISS property l|2.(j|l for all 
Euler solutions x(t) of (|2.4|) . We will actually prove the slightly stronger version of 
the theorem for generalized Euler solutions, as asserted in Remark 12.41 To this end, 
choose u £ M ra , i„ € R n , and e > 0. Using our previous conclusion that (|1.3fl is ISS 
for sampling solutions, we can let 

5 S = 5(e, \x \, \u\oo) and K e = K (e, |x |, |u|oo) 

be the constants from Definition 12.21 Let x{t) be a generalized Euler solution of 
Q2.4JI . and let 7r r , u r , and e r satisfy the requirements of the generalized Euler solution 
definition. It follows from the definition that there is an f G N such that 

d(7r r ) < 5 e , sup(e r ) < K e d(it r ) 

for all r > f. It then follows from 13.21fl that 

(3.26) \xir r (t; x , u r , e r )\ < j3{\x D \,t) + 7(|u|oo) + £ 

for all t > and r > f, where f3 and 7 are in 13.25fl . The ISS condition 1)2. 6|l now 
follows by passing to the limit in l|3.26|l as r — > 00, since e > was arbitrary. This 
concludes the proof of Theorem ll.il 

4. Stabilization of the Nonholonomic Integrator. In this section, we illus- 
trate how the feedback constructed in ^Jcan be used to stabilize Brockett's nonholo- 
nomic integrator control system (see [31EI1G2])- We will also use the nonholonomic 
integrator to compare our feedback construction to the feedbacks from |19l I2()| . The 
nonholonomic integrator was introduced in 0, as an example of a system that cannot 
be stabilized using continuous feedback. It is well-known that if the state space of a 
system contains obstacles (e.g., if the state space is M 2 \ (— 1, l) 2 , and therefore has 
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a topological obstacle around the origin), then it is impossible to stabilize the sys- 
tem using continuous feedback. In fact, this is a special case of a theorem of Milnor, 
which asserts that the domain of attraction of an asymptotically stable vector field 
must be diffeomorphic to Euclidean space, and therefore cannot be the complement 
R 2 \ (-1,1) 2 (see EU). 

Brockett's example illustrates how, even if we assume that the state evolves in Eu- 
clidean space, similar obstructions to stabilization may occur. These obstructions are 
not due to the topology of the state space, but instead arise from "virtual obstacles" 
that are implicit in the form of the control system (see [22]). Such obstacles occur 
when it is impossible to move instantly in some directions, even though it is possible 
to move eventually in every direction ( "nonholonomy" ) . This gives rise to Brockett's 
criterion (see [3]), which is a necessary condition for the existence of a continuous 
stabilizer, in terms of the vector fields that define the system (see [!n] |22 ES]). The 
nonholonomic integrator does not satisfy Brockett's criterion, and therefore cannot 
be stabilized by continuous feedbacks. 

The physical model for Brockett's example is as follows. Consider a three-wheeled 
shopping cart whose front wheel acts as a castor. The state variable is (xi, X2, 6) T , 
where {xi 1 X2) T is the midpoint of the rear axle of the cart, and 9 is the cart's orien- 
tation. The front wheel is free to rotate, but there is a "non-slipping" constraint that 
(±i,±2) T must always be parallel to (cos(0), sin(6>)) T . This gives the equations 

xi = v\ cos(#) 

(4.1) x 2 = visin(6>) , 

= v 2 

where v\ is a "drive" command and v% is a steering command. Using the feedback 
transformation 

Z\ := 8, Z2 := x\ cos(0) + x 2 8111(6*), Z3 := x\ sin(6 l ) — X2 cos(0) 
U\ := v 2 , u 2 := vi — v 2 z 3 

followed by a second transformation, brings the equations l|4.1|l into the form 

Xl = U\ 

(4.2) ±2 = u 2 

±3 = X1U2 - X 2 Ui 

which is called the nonholonomic integrator control system. 

One can show (see ^T]) that (|4.2|l is a GAC system. However, since Brockett's 
condition is not satisfied for 1)4. 2f> . the system has no continuous stabilizer. While 
there does not exist a C 1 CLF for the system <|4.2II (see ^ is now well-known 

that every GAC system admits a continuous CLF (see ^B])- I n fact, it was shown in 
[TU| that the nonholonomic integrator dynamics 14.2fl has the nonsmooth CLF 




which is semiconcave outside the cone x\ = 4(xf +x\) (see ^J] for a detailed discussion 
of some special properties of this CLF). For the special case of the dynamics (|4.2|l 
and CLF l|4.3|) . the feedback K = K\ + K2 we constructed in J5]is as follows. 
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To simplify notation, we use the radius r(x) :— y 1 x\ + x\. We also use the sets 



S = {x e R 3 
S+ = {x e R 3 
S- = {x e R 3 



x 3 ± 0, r{x) = 0} 
x\ > Ar 2 (x) > 0} 
x\ < Ar 2 (x)} 



which form a partition of R 3 \ {0}. Notice that V(x) = r(x) on 5_, and also that 
V(x) = \xs\ — r(x) on R 3 \ S-. To find our selection ((x) G 8lV(x), we first choose 
C(0) = 0, and ((x) = (0, -1, sgn{x 3 }) T for all x G S Q . Using the notation of (|3.4j) . 
this gives 

( -x 2 sgn{x 3 } - xi/r(x), xisgn{x 3 } - x 2 /r(x) ) T , x G S+ 
(4.4) b(x) = { (xi/r(x), x 2 /r(x)f, xel 
(0,-lf, x£S 

and b(0) = 0. Notice that 1 < \b(x)\ 2 < r 2 {x) + 1 for all x ^ 0. We also have 

Hx(x) ( -a; 2 sgn{a;3} - x 1 /r(x), xisgn{a;3} - x 2 /r(x) ) T , x G S+ 
Ki(x)={ -{x ll x 2 ) T , x G 5_ 

(0,|x 3 |) T , ieS„ 

with -?G.(0) = 0, where we have set 

r(x) - |a?3 1 

WW : = 2TTTT" - 
r z {x) + 1 

In this case, we have taken 

K^x) = -b{x)V{x)/\b{x)\ 2 

for a; ^ 0, where b(x) is defined in (|4.4|) . and Ki is continuous at the origin. On the 
other hand, our feedback K 2 from l|3.4[) becomes 



{(H 2 {xi,-x 2 ,x), At 2 (x 2 ,xi,x) ) , ieS + 

r(x)(sgn{xi}, sgn{a; 2 }) T , x G S_ 

N(0, -l) T , xeS 

with if 2 (0) = 0, where we have set 



fj, 2 {a,b,x) := (|x 3 | - r(x)) sgn{ 6r(x) sgn{x 3 } - a }. 



Since V is semiconcave on := R 3 \bd(SL), the argument from ^applies to sampling 
solutions that satisfy the additional requirement that x n (s) G ft for all s > 0. It follows 
from the proof of Theorem II . 21 that the nonholonomic integrator system (|4.2|) can be 
stabilized for both actuator errors and small observation errors (for this restricted set 
of sampling solutions), using the combined feedback K = K\ + K 2 . 

Remark 4.1. In this example, we chose to work with the CLF H4.3J) because it 
has been explicitly proven in JOj to be a CLF for the control system (14. 2|) . The 
example illustrates how to extend our results to more general CLF's that may not be 
semiconcave on R 3 \ {0}. For such cases, the ISS estimates hold for those sampling 
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solutions that remain in the domain of semiconcavity of the CLF. On the other hand, 
we let the reader prove that the nonholonomic integrator system also has the CLF 

V(x) = [yjx* + X* - \x 3 ?j +xl 

which is semiconcave on R 3 \ {0} (as the sum of the smooth function x\ + x\ + 2x§ 
and a semiconcave function). Therefore, if we use V to form our feedbacks, instead 
of the CLF (|4.3|l . then our theorems apply directly, without any state restrictions on 
the sampling solutions. 

Remark 4.2. The results in JU] designed feedbacks that make C°-stabilizable 
systems ISS with respect to actuator errors. For the case of C°-stabilizable systems, 
a smooth (i.e., C°°) Lyapunov function is known to exist (see pQ). In JH], the system 
was rendered ISS using the feedback 

(4.5) K(x) := -L G V(x) = -VV(x)G(x), 

where V is a smooth CLF for the dynamics (|1 . 1|> . In that case, (|4.5(l is continuous 
at the origin. However, in the more general situation where the system is merely 
GAC, there may not exist a smooth Lyapunov function, so V must be taken to be 
nonsmooth. In this case, the use of the nonsmooth analogue 

(4.6) K(x) := -C(x)G(x) 

of H4.5JI (where (^(x) £ 8lV(x) for all x ^ 0) could give rise to a feedback that would 
not be continuous at the origin. For example, if we use the nonholonomic integrator 
(|4.2|) and the CLF (|4.3p. then K takes the values 

*«....«n = - (^) T - *(<«^> T ) - (^•^) T+ *- 1 > T 

so K is discontinuous at the origin. On the other hand, our choice of K2 is automat- 
ically continuous at the origin. 

Remark 4.3. Under the additional hypothesis that l|l.lfl satisfies the small control 
property (see [21]), the system can be stabilized by a feedback that is continuous at the 
origin (see ^7J). More precisely, suppose there exists a semiconcave CLF V satisfying 
the following: For each e > 0, there exists 6 = 5(e) > such that < \x\ < S implies 

3u x e eB m s.t. VC G dpV(x), ((, f(x) + G{x)u x ) < -V(x). 

Then the system can be rendered globally asymptotically stable (GAS) by a feedback 
that is continuous at the origin (see ^7]). For the case of the nonholonomic integrator 
(14.211 . the system is GAS under our feedback K\, which is continuous at the origin, 
so our total feedback K = K\ + K2 is continuous at the origin as well. 

5. ISS for Fully Nonlinear GAC Systems. We conclude with an extension 
of our results for fully nonlinear GAC systems 

(5.1) x = f(x,u) 

where we assume for simplicity that the observation error e in the controller is zero. 
We assume throughout this section that 

/ : W 1 x K m -> M" : (x, u) h-> f(x, u) 
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is continuous and locally Lipschitz in x uniformly on compact subsets of K ra x R m 
and /(0, 0) = 0. It is natural to ask whether these hypotheses are sufficient for the 
existence of a continuous feedback K(x) for which 



is ISS for Euler solutions. However, one can easily construct examples for which such 
feedbacks cannot exist. Here is an example from |20j where this situation occurs. 
Consider the GAC system x — —x + u 2 x 2 on R. If K{x) is any continuous feedback 
for which 



is ISS, then |if (a;)| < x 1 / 2 for sufficiently large x > 0. It follows that the solution of 



starting at x(Q) = 4 is unbounded. Therefore, there does not exist a continuous 
feedback K for which (|5.3[) is ISS. On the other hand, one can find a (possibly dis- 
continuous) feedback that makes (|5.1(l ISS. We use the following weaker sense of ISS 
for fully nonlinear systems that was introduced in |2(J|: 

Definition 5.1. We say that $5.1)) is input to state stabilizable in the weak 
sense provided there exist a feedback K , and an m x m matrix G of continuously 
differ entiable functions which is invertible at each point, such that 



is ISS for sampling and Euler solutions, where F{x,p,u) — f(x,p + G(x)u). 
We will prove the following: 

PROPOSITION 5.2. // \5.1\) is GAC, then $5.1}) is also input to state stabilizable 
in the weak sense. 

Proof. We modify the proof from 33 We define V, Cj 9L-, a, and K\ as in the 
proof of Theorem 11.21 except we use the fully nonlinear dynamics h = f from (|5.1[) . 
Next we follow the proof of the main result in 1201) with the following modifications. 
Define the (possibly discontinuous) function V by 



r = r(i) > such that s E I implies T)(s,b) < for all b € [0,r]. This follows from 
the positive definiteness of V, the local Lipschitzness of /, and the local boundedness 
of dpV on compact subsets of W 1 \ {0}. 

The argument of |2U| therefore gives S /Coo and a smooth, everywhere invertible 
matrix- valued function G : R™ — > R mxm satisfying the following: If 

(5.5) \x\ > a 4 (Ks)|oo), 

then for a.e. t > 0, 



(5.2) 



x = f(x, K(x) + u) 



(5.3) 



x = -x + (K(x) + ufx 2 



x = -x+ {K{x) + ifx 2 



x — F(x, K(x), u) 




(ax)J(x,K 1 (x) + G(x)u(t))) + 



V{x) 



< V(\x\,\G(x)u{ S )U) <Q. 



2 
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(See Remark 15.31 for a characterization of the set of matrices G for which ISS can 
be expected, in terms of V.) We can evidently assume that a±{s) > s for all s > 
(e.g., by replacing ct4,(s) by max{«4(s),s}, which makes the condition l|5.5|) more 
restrictive). Fix M, N, e G (0, M), u G .M™ and x(t) = x n (t) as before, with e = 0. 
Define the compact sets 

S:= : V(x) < gT 1 o au(N)} , Q= {(a o a _1 (Af + a 4 (iV)) + 1)S„} \ eB n . 

Notice that S C Q e . We choose e as before, and we choose <5 = 6(e, M, N), satisfying 
(|3.11() . such that if d(7r) < 6, then 

(5-6) \x„(t)-Xi\ < min j^, iq^i + z ) , \J^^ t " tl ^ 

for all indices i such that Xi G Q £ and all t G [t^ , ii+i] , where a and are as defined 
before, and A_ = \am{V(x) : x € Q e ^ 4 }- Reducing 5 as necessary, we can assume 

||C(x^-[/(x I ,^ 1 (xO + G(xOu(s))-/(x( s ),X 1 (xO + G(x( s )) u ( s ))]|| [ti:t!+l] < ^ 

for all indices i satisfying Xi € Q 6 ^ 2 . Reasoning as in the earlier proof gives 

V(x n (t)) - V( Xi ) < -(* - U)^§^ V* G [ti,ti+i] 

16 

for all i such that Xj G Q e ^ 4 \ S. The remainder of the proof is as before, except with 
aoa~ 1 (N) replaced by aoa _1 (a4(iV)), and with aoa~ 1 (s) replaced by aoa _1 (a 4 (s)) 
in the definition of 7. This proves Proposition |^J □ 

Remark 5.3. The statement of Proposition 15.21 is an existence result in terms of 
the invertible matrix 67. However, we can strengthen the proposition by using the 
function T> in (|5.4|) to characterize the class of G for which ISS can be expected, as 
follows. Following f3U|, we first choose strictly decreasing sequences {rj} and {r^} of 
positive numbers such that < r^+i <r' i <ri for all i G N, and such that 

V{s,r) <0 V(.s,r) G ([»,*+ 1] x [0, n}) U ([l/(i + 1), l/i] x [O.rfl) 

for all i £ N. The existence of these sequences follows from the argument we gave in 
the proof of the proposition. Define p : [0, 00) [0, 00) by setting: 

(pi) p(s) = r k for all s G [k, k + 1) and fc G N; 

(p2) p(s) = r' k for all s G [l/(fc + 1), l/k) and fc G N; and 

(pi) p(0) = 0. 

We then choose any smooth function g : [0, 00) — > (0, 00) satisfying: 

(ffl) g(s) = 1 for all s G [0, 1]; 

(52) g(s) < p(s)/s for all s > 2; and 

(33) 3(5) < 1 for all s > 0. 
The existence of such a function g follows from exactly the same argument used in 
|2(Jj . It then also follows from the argument of 1201 that we can satisfy the conditions 
of the proposition by choosing G(£) = <?(|£|)7. 

Proposition ^ . 2l allows us to characterize GAC for fully nonlinear systems in terms 
of feedback equivalence, as follows. First recall that two systems x = f(x, u) and 
x = h(x, u), evolving on K™ x IR m , are called feedback equivalent provided there exist 
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a locally bounded function K : W l — » M m and an everywhere invertible function 
G : W l -> E mxra for which 

h{x,u) = f(x,K(x) +G(x)u) 

for all x £ M. n and u 6 K m ; in this case, we also say x — f(x, u) is feedback equivalent 
to (|2.1|) with e = and F(x,p,u) — f(x,p + G(x)u). The following elegant statement 
follows directly from Proposition 15. 21 

COROLLARY 5.4. The fully nonlinear system \5.1)) is GAC if, and only if, it is 
feedback equivalent to a system which is ISS for sampling and Euler solutions. 

Remark 5.5. Although, as shown by the counterexample Ij5.3|) . it is in general 
impossible to obtain input to state stabilization (in the non-weak sense) for systems 
that are not affine in controls, it is still the case that for some restricted classes of sys- 
tems this objective can be attained, under appropriate neutral-stability assumptions 
on the dynamics. One such class is that of systems in which the input appears inside 
a saturation nonlinearity, such as x — f(x,u) = fo(x) + g(x)a(u). The papers [Tlj 
and [S] (see for an application of these results to the recursive design of stabilizers 
for a large class of systems with saturation) as well as 0] and ^3] dealt with such 
questions, for systems that are linear in the absence of the saturation (the /o and g 
vector fields are linear and constant, respectively), while 2 obtained similar results 
for more general nonlinear systems. 
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